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[57] ABSTRACT 

A handwritten pattern approximated to a series of po- 
lygonal lines consisting of segments is compared with a 
candidate pattern selected from dictionary patterns 
stored in the memory, basing on the angular variation 
between adjacent segments of both patterns. If the dif- 
ference between angular variations of adjoining seg- 
ments of both patterns is outside of a certain range, it is 
tested whether the difference between an angular varia- 
tion across three or more consecutive segments and the 
above reference angular variation is within the range. 

11 Claims, 10 Drawing Figures 
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METHOD AND APPARATUS FOR ON-LINE SUMMARY OF THE INVENTION 

RECOGNIZING HANDWRITTEN PATTERNS This invention is intended to overcome the foregoing 

„ P rior deficiency, and its prime object is to provide a 

CROSS-REFERENCE TO RELATED 5 method and apparatus for recognizing handwritten 

APPLICATION patterns operative to correctly recognize even rotated 

This invention is related to U.S. patent application handwritten patterns and variations of patterns, 
Ser. No. 686,001 filed on Dec. 24, 1984 now U.S. Pat. Generally, a pattern can be defined by a group of 
No. 4,653,107 assigned to the same assignee. segments and their linkage relationship. It is not easy for 

10 hand-writing to draw a complete straight line and arc, 
BACKGROUND OF THE INVENTION and the ambiguity of hand-writing creates unnecessary 

This invention relates to a method and apparatus for ' segments ' resulting generally in an increased number of 
ON-LINE recognizing handwritten patterns and, par- segments, 

ticularly, to a method and apparatus for ON-LINE ^ mveiltive handwritten pattern recognition sys- 
recognizing handwritten patterns which are liable to 15 tem operates in such a way that a handwritten pattern is 
variation and rotation. decomposed into a series of segments and the angular 

A conventional handwritten pattern recognition sys- variation between adjoining segments, in consideration 
tern operates in such a way that each handwritten stroke ? f the aa 8 ular variation across three or more segments, 
is divided into numerous short vectors and it is tested „ ? compared with the angular variation between adjoin- 
whether part or all of the vectors match the majority of 20 m S * e ^ rats of a candidate dictionary pattern, and the 
vectors of a candidate pattern in the dictionary, as de- ^guity of hand-writing is overcome and correct 
scribed in an article entitled "Application of DP Match- pa " er ? ^S^ 011 18 made possible. In the angular 
ing Process to Character Recognition", Nikkei Elec- variation comparing process, the starting segment of a 
tronics, pp. 198-199, Nov. 7, 1983. This method is capa- « to*"""^ pattern is shifted sequentially, which allows 
ble of character recognition even if the dimension of the fCCOgmtlon of a totated handwritt «i pattern, 
input vectors differs from that of the dictionary vectors BRIEF DESCRIPTION OF THE DRAWINGS 
and is advantageous in recognizing correct-attitude jnr-Q ^ . t . , , . 

handwritten patterns. However, because of the compar- i w J^. *** .digrams (explaining a typical 
ison process based on the direction of each vector, , n 

when a rotated character is entered, which results in a 30 l tT^F *"* r ^ , • 

change in the direction of each vector, it becomes diffi- J5Xi£ tS^ £T- bandwn f ten P attera 
cult to recognize the character, and therefore the r ^*™ sv f m embodying the present mvention; 
method could not readily be appUed directly to pattern SV8 ^m Iv^Sc^f P 5 ' ° paMm ° f 
recognition where the rotation of pattern occurs fre- « L ^ ?• , ■ • . 

quenctly 35 FIGS. 4a and 4b are diagrams explaining the process 

There has been proposed another handwritten pat- ^ dwrittra P^ern to po- 

E*3^^ ™ * ^ 5, are diagrams explaining the polygc 

segments, comparison is carried out betwel m 5?^^^ 

Urn recognition method accord 
ten pattern is recognized depending on the degree of FIG. 7 is a diagram showing an example of the 

method is entirely based on the comparison of the angu- 

lar variations of adjoining segments between an input DESCRIPTION OF THE PREFERRED 

handwritten pattern and candidate patterns in the die- EMBODIMENTS 

50 The present invention will now be described in detail 
wntten patterns which are rich in variation. Namely, in with reference to the accompanying drawings. 

™J2™ ^ PUt , h Pf"* 18 appr ° ximal ? d FIG. 2 showing in block diagram an embodiment 

to segments al, a2 and b, and adjoining segment pairs of this invention, strokesof a pattern written by hand on 

al-a2 and a2-b have angukr vanations AM and A02, a tablet 1 are sampled periodically by a sampling unit 2 

respectively. In the recognition process, the input hand- 55 and converted into plote on the 2^mensional coordi- 

wntten pattern of FIG. U which is pertinent to a die- nates. The plots are stored temporarily in a file 3. A 

pattern shown in FIG. Ifc the angular variation polygonal line approximation unit 4 reads out the plots 

Ml between the adjoining segments al and a2 of FIG. in the file 3, eliminates intermediate plots residing on 

lo is compared with the angular variation 9 between the straight line segments so that the strokes are approxi- 

adjoming sepnents a and b' in FIG. 16, resulting occa- 60 mated to groups of polygonal lines, and they are stored 

sionally in a judgement of inconsistency. The presence in the file 3. A tracing unit 5 traces in a certain direction 

of the segment a2 m FIG. la is a result of a significant the sequence of the polygonal lines read out of the file 

variation in the mput handwritten pattern, and for a 3 to produces a series of segments, and stores the result 

reasonable pattern recognition process, the angular in the file 3. A matching unit 6 reads out the series of 

variation across the three consecutive segments al, a2 65 input segments and a series of reference segments from 

and b (i.e., A01+A02) should be compared with the the file 3, and makes decision for the consistency or 

angular variation between the adjoining segments a' and inconsistency between both series of segments. If the 

b of the dictionary pattern shown in FIG. lb. consistency has resulted, a display data generating unit 
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7 produces a clean pattern for the recognized input 
pattern, and operates on a display unit 8 to display it. 

Next, each of the above processing steps will be de- 
scribed in detail with reference to FIGS. 3, 4 and 5. 

FIG. 3 shows in flowchart the sequential operations 5 
implemented by the tablet 1 through tracing unit 5 in 
FIG, 2. Initially, in step 31, handwritten strokes as 
shown are entered through the tablet 1. The entered 
handwritten strokes are sampled at a speed of 100 points 
per second, for example, by the sampling unit 2 in FIG. 10 
2 so that a series of plots as shown are formed on the 
coordinates in step 32. In the subsequent step 33, the 
sampled plots are rendered polygonal approximation, as 
shown, by the polygonal approximation unit 4 in FIG. 
2. The polygonal approximation takes place as shown in 15 
FIG. 4a in such a way that a chord 1 connecting two 
points P2 and P7 is specified and then the area S27 
enclosed by the chord 1 and the polygonal lines P2 
through P7 is calculated. If the area S27 is smaller than 
the threshold value Sth(l) which is a function of the 20 
chord 1, i.e., S27<Sth(l), the curve connecting the two 
points P2 and P7 is approximated to a straight line. 
Conversely, if the area S27 is larger than the threshold 
value Sth(l), ic, S27>Sth(l) the point S7 is replaced 
with point P6 so that the distance from the point P2 25 
decreases and the above process is repeated, and even- 
tually a polygonal approximation as shown in FIG. 4b is 
reached. The example shown in FIG. 3 will result in a 
polygonal approximation as shown in step 33 of FIG. 3. 
In the subsequent step 34, the result of polygonal ap- 30 
proximation is processed by the tracing unit 5, and the 
polygonal lines are converted into segments. Namely, 
the polygonal lines are traced starting with segment a 
• up to the last segment n in a certain direction (e.g. r 
clockwise direction), and a set of segments as shown is 35 
produced. 

The operation of the matching unit 6 for comparing a 
series of input segments obtained in step 34 with a series 
of reference segments in the dictionary is as follows. In 
the matching process, the angular variation between 40 
two adjoining segments is used as a characteristic value 
for comparison. For example, the initial four segments 
al, a2, a3 and a4 shown in step 34 of FIG. 3 yield the 
angular variations shown in FIG. 5a FIG. 5b shows a 
set of reference segments of part of the dictionary pat- 45 
tern pertinent to the input segments. The matching 
process compares the input angular variations A01, A02 
and A03 yielded by the input segments derived from the 
polygonal lines which approximate the handwritten 
pattern with the angular variations 01 and 02 for the 50 
segments derived from the corresponding portion of a 
candidate pattern in the dictionary. 

In FIG. 6 showing in flowchart the above matching 
process, step 11 sets the variables i and j to "1", sets the 
sum of angular variations, K, to "0", sets the degree of 55 
partial difference D, to "0", and resets the flag which 
indicates the comparison result to be within a certain 
range. The subsequent step 12 adds the input angular 
variation A0i to the summed angular variation K. Since 
the summed angular variation K and variable i have 60 
been initialized to "0" and "1" respectively, in step 11, 
the operation of the first cycle yields K— A01. 

The subsequent step 13 tests whether the summed 
input angular variation K is within the range of the 
reference angular variation 0j plus/minus a, where a is 65 
preset to a value which is a quarter of the reference 
angular variation 0j, for example. If the test result in 
affirmative, i.e., K is within 0j ±a, the subsequent step 



14 sets the flag indicative of "in-range" and calculates 
the partial difference D. The partial difference D is 
calculated by adding the absolute value of the differ- 
ence between the input angular variation A0i and the 
summed input angular variation K to the previous par- 
tial difference D, and it provides an estimation value 
indicative of the degree of variation of a handwritten 
character. Conversely, if the step 13 provides a negative 
test result, i.e., K is outside the range 0j ±a, the subse- 
quent step 15 tests whether the flag has been set in the 
operation of the previous cycle. If the flag is found 
reset, step 17 updates the partial difference D by adding 
the summed angular variation K to the partial differ- 
ence D of the previous cycle. Namely, adjustment is 
made such that the more the number of unnecessary 
input segments, i.e., the more the number of adding 
operations for angular variations, the greater partial 
difference will result. If, on the other hand, the flag is 
found set in step 15, the summed regular variation K is 
reset to zero, the variables i and j are decremented and 
incremented by one, respectively, and the flag is reset 
The variable i is incremented by one in step 18, and a 
new angular variation 0j of the dictionary pattern is 
retrieved through the above operations and compared 
with the last input angular variation A0i outside the 
range. 

Step 19 tests whether checking for at least one of 
input angular variations and dictionary angular varia- 
tions is completed, and, if it is affirmative, step 20 di- 
vides the partial difference D by the number of dictio- 
nary segments, N, so as to evaluate the final difference. 

Next, the matching process for the case shown in 
FIGS. 5a and 5b will be described with reference to the 
following table 1. 

TABLE 1 



Processing 


Process step 


K(~A*i)«0t-a) 


12, 13 


Reset flag. D«D+|K| 


15, 17 


(0|-a)<K(=A0i+A02)<(0l+a) 


12, 13 


D=D-|-|0|-K|; set flag. 


14 


K (= A0i Afi 3 )<(0l -a) 


13, 15, 18 


Set K to "0", reset flag; set i 




to M 3", set j to **2" 




(6*-a)<K(«M3)<(02+a> 


12, 13 


D=D+|*j-K|, set flag 


14 



An item 1, the reference angular variation 01 and 
input angular variation A01 are taken out, and it is 
found that the summed input angular variation K, 
which is A01 at this time, is smaller than 01-a (step 13). 
Next, at item 2, the flag is left reset so as to indicate that 
the input angular variation 01 is outside the specified 
range, and the partial difference D is made equal to K 
(i.e., A01). At the next item 3, the total input angular 
variation K is made equal to A01+A02, and it is found 
that the summed input angular variation K is within the 
specified range. At item 4, the flag is set and at the same 
time 1 01-K | is added to the partial difference D so as to 
produce a new partial difference D. At the next item 5, 
the summed input angular variation K is made equal to 
A01+ A02+ A03, and it is found that this value is out of 
the specified range, with the flag being reset and the 
summed input angular variation K being reset to zero. 
At the next item 6, a new reference angular variation 02 
is taken, a new summed input angular variation K is 
made equal to A03, and it is found that the value K is 
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within the specified range. At the next item 7, the flag is above example, the dictionary candidate pattern con- 
set and the partial difference D is updated sists of eight blocks Bl'-B8', equal in number to the 
In the example shown in FIGS. 5a and Sb. it is found blocks from the recognition commencement to the end, 
that the input A01 and A02 correspond to the reference and it means that character recognition may have been 
angular variation 61 and the matching process is obvi- 5 possibly implemented correctly. However, there may 
ously possible even if an input pattern and a dictionary exist more than one candidate pattern equal in the nura- 

S^^l^^fSTSf T "TT' ^tfe* ber of blocks t0 *P ut P atte ^ before « 

P r^Snt * Z a £ ~ ^ * , • merd y basbl « on of number of blocks. 

nSSf l^rf ^^if'T^ Ti? m a 10 111 such to ™ te *"S Process is conducted S 

e^^^ candidatepattemshavmgfhesamenumberofbl^ 

pattern one bTone! vananon 01 ™ ac&onary evaluated. Hen, among all a candidate pattern with the 

FiaTshowsanexampleofc^rrespondencebetween 15 

segments of an input pattern and se^nents of a dictio- J? pa "T * ^ numbeTS of 

nary pattern. The input segment varies from segment a ™ ? PUt ^^/^ 15 P rovcd 

tobtocandsoone, with the direction of angulivaria- * V * pr °" 

tion (clockwise or counterclockwise) being indicated °^ t f? r ^ u bk >? k * e P™"** a successful result, 
by the arrows Rl, R2. R3, R4 and R5. Similarly, the 20 ^"^ugh foregoing embodiment is of the case of 

dictionary segment varies from segment a' to V to c' cna 5 a ? ter "cognition basmg mercly on ^ angu]ar 

and so on, with the direction of angular variation being vanatK>n °* the ™pat segment set and dictionary seg- 

indicated by the arrows R1',R2', R3' and so on. The m ? at to P resent invention is not confined to this 

dictionary segment sets LI and L2 are the same, and scheme ' but to recognition process may further deal 

they are provided with the intention that the recogni- 25 ^ ?" additional parameter 0 indicative of the length 

tion process will complete until the last block of L2 of adjacent segments of a character so as to more clarify 

even if the input pattern has begun to yield a matching tbc feature of eacn character. In this case, polygonal 

result at an intermediate block of LI. wnic h approximate an input pattern not only pro- 

The following describes the process in more detail. In angular variations of adjacent segments, but also 
FIG. 7, block Bl of the input pattern and block Bl' of 30 P rovide ra tios of lengths of adjacent segments. For 
the dictionary candidate pattern, each showing an angu- example, instead of the summed angular variation K 
lar variation, have their angular variations in the same shown in FIG. 6, an estimation function of Kx& where 
direction as shown by the arrows Rl and RT, and there- £ is the abovementioned parameter, is preferably em- 
fore the matching process can be commenced with the ployed. 

tie of blocks Bl and Bl'. Once the matching process for 35 1x1 addition, it will be appreciated that the matching 

the blocks Bl and Bl' has been commenced, however, process for the input and candidate patterns may be 

the subsequent blocks B2 and B2' reveal angular varia- preceded by the calculation of the number of blocks 

tions in opposite directions as shown by the arrows R2 which indicate the angular variation directions of an 

and R2', and it is found that the blocks B2 and B2' do ^put pattern as shown by B1-B5 in FIG. 7 and the 

not match each other. Accordingly, it is found to be 40 selection of candidate patterns having the same number 

impossible for the input segments a, b, c and so on to °f blocks as calculated among dictionary patterns, 

reach a matching result through the commencement of ^ described above, the inventive handwritten pat- 

the matching process from block Bl', ie. segment a', of tern recognition method and apparatus are capable of 

the dictionary candidate pattern. Symbol V in the correct pattern recognition even for deformed or ro- 

flgure indicates the failure of matching between seg- 45 tated handwritten patterns, 

ments of both patterns. We claim: 

The next trail of matching process for the block Bl of 1- A method of recognizing handwritten patterns 

the input pattern is to commence with block B2' of the comprising the steps of: 

dictionary candidate pattern. The blocks Bl and B2' (a) sampling strokes of a handwritten pattern to pro- 
have their angular variations in the same direction as 50 duce a series of sampled plots on a plane of coordi- 
tndicated by the arrows Rl and R2', and the result of nates; 

matching is reached. Comparing the subsequent blocks (b) segmenting the series of sampled plots to a series 

B2 and B3' reveals that their angular variations are in of polygonal lines, which approximate the hand- 

the same direction, and these segments match each written pattern, consisting of segments; 

other. In the same way, ties of blocks B3 and B4', blocks 55 (c) evaluating the angular variation between adjoin* 

B3 and B5', blocks B4 and B6' ( blocks B5 and BT, ing segments by tracing the series of polygonal 

blocks B5 and B8', and blocks B5 and Bl' (in dictionary lines in a certain direction so as to determine a 

segment set L2) for all corresponding combinations of series of input angular variation values; 

the input segments and dictionary segments reach the (d) reading out a candidate pattern from a dictionary 

result of matching. In order for an input pattern to be 60 storage which stores a plurality of dictionary pat- 

identified to be a candidate pattern in the dictionary, it terns, each of which is expressed in terms of a series 

is necessary that the number of blocks counted from the of reference angular variation values deterrnined as 

block of the dictionary sequent set at which the recogni- angular variations of adjoining segments by tracing 

tion process has commenced (block B2' of dictionary the series of segments of the pattern in said direc- 

segment set LI in the above example) up to the ending 65 tion; 

block (block Bl' of dictionary segment set L2 in the (e) comparing an input angular variation value se- 

abo ve example) is equal to the number of blocks which iected from said series of input angular variation 

constitute the candidate pattern in the dictionary. In the values with a reference angular variation value 
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selected from said series of reference angular varia- 
tion values; 

(f) if the comparison result is outside of a certain 
range, adding input angular variation values of said 
series of input angular variation values to the se- 5 
lected input angular variation value one by one so 
that the comparison result is inside of said range; 

(g) if the comparison result in step (e) or (f) is inside 
of said range, determining a partial difference be- 
tween the input pattern and the candidate pattern 10 
in accordance with the comparison result, and 
thereafter repeating said steps (e), (f) and (g) for 
comparing a next input angular variation value 
selected from said series of input angular variation 
values with a next reference angular variation 15 
value selected from said series of reference angular 
variation values; and 

(h) determining an ultimate difference between the 
input pattern and the candidate pattern upon com- 
pletion of comparison for at least one of said series 20 
of input angular variation values and said series of 
reference angular variation values. 

2. A pattern recognition method according to claim 1 
further comprising the steps of: 

(i) repeating said steps (d) through (h) for reading out 25 
another candidate pattern from said dictionary 
storage; and 

(j) determining a candidate pattern which provides a 
minimal ultimate difference to be a recognized 
pattern for the input pattern. 30 

3. A pattern recognition method according to claim 
1, wherein said step (g) comprises the substeps of: 

(i) after said partial difference has been determined, 
adding input angular variation values of said series 
of angular variation values one by one to said input 35 
angular variation value to be compared so that the 
comparison of the summed input angular variation 
value with the reference angular variation value 
falls outside of said range; and 

(ii) if the comparison result is outside of said range, 40 
repeating said steps (e), (f) and (g). 

4. A pattern recognition method according to claim 
1, wherein said ultimate difference is determined from 
the ratio of a sum of the partial differences to the num- 
ber of angular variation values of said series of reference 45 
angular variation values. 

5. A pattern recognition method according to claim 
1, wherein said partial difference is renewed in accor- 
dance with said summed input angular variation value 
at each adding operation in said step (f). 50 

6. A pattern recognition method according to claim 
1, wherein said input angular variation value and refer- 
ence angular variation value have polarities indicative 
of the direction of angular variation. 

7. A pattern recognition method according to claim 55 
6, wherein said range extends by a quarter of a selected 
reference angular variation to the positive side and 
negative side of the selected reference angular variation 
value. 

8. A handwritten pattern recognition apparatus com- 60 
prising: 



103 

8 

sampling means which samples strokes of a handwrit- 
ten pattern to produce a series of plots on a plane of 
coordinates; 

segmentation means connected to said sampling 
means and adapted to convert the series of plots to 
a series of polygonal lines, which approximate the 
input pattern, consisting of segments; 

means connected to said segmentation means and 
adapted to produce a series of input angular varia- 
tion values, each representing an angular variation 
between adjoining segments, by tracing the series 
of polygonal lines in a certain direction starting 
with an end of an arbitrary segment; 

means for memorizing a plurality of reference pat- 
terns in the form of a series of reference angular 
variation values, each representing an angular vari- 
ation value between adjoining segments, by tracing 
segments of each pattern in said direction; and 

pattern recognition means connected to said input 
angular variation producing means and said memo- 
rizing means and adapted to compare an input 
angular variation value selected from said series of 
input angular variation values with a reference 
angular variation value selected from said series of 
reference angular variation values of a candidate 
pattern retrieved from said memorizing means so as 
to determine a partial difference between said input 
pattern and said candidate pattern when the com- 
parison result is within a certain range, said pattern 
recognition means comparing a sum of two or 
more input angular variation values derived from 
said series of input angular variation values with 
the selected reference angular variation value 
when the comparison result is outside of said range, 
and calculating an ultimate difference between the 
input pattern and the candidate pattern based on a 
sum of partial difference upon completion of com- 
parison for all angular variation values of at least 
one of said series of input angular variation values 
and said series of reference angular variation val- 
ues. 

9. A pattern recognition apparatus according to claim 
8, wherein said pattern recognition means repeats said 
comparison operation by changing the combination of 
an input angular variation value and a reference angular 
variation value. 

10. A pattern recognition apparatus according to 
claim 8, wherein said pattern recognition means uses the 
ratio of lengths of adjoining segments as elements of 
comparison in comparing an input angular variation 
value with a reference angular variation value. 

11. A pattern recognition apparatus according to 
claim 8, wherein said pattern recognition means deter- 
mines the direction and number of angular variations of 
said series of input angular variation values as a prepro- 
cessing of comparison of an input angular variation 
value and a reference angular variation value, and se- 
lects a reference pattern in said memorizing means hav- 
ing a same direction and number as those of said input 
angular variation value as a candidate pattern. 



65 
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